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A ROBBINS MONRO PROCEDURE FOR ESTIMATION IN 
SEMIPARAMETRIC REGRESSION MODELS 

By Bernard Bercu and Philippe Fraysse 



This paper is devoted to the parametric estimation of a shift to- 
gether with the nonparametric estimation of a regression function 
in a semiparametric regression model. We implement a very efficient 
and easy to handle Robbins-Monro procedure. On the one hand, 
we propose a stochastic algorithm similar to that of Robbins-Monro 
in order to estimate the shift parameter. A preliminary evaluation 
of the regression function is not necessary to estimate the shift pa- 
rameter. On the other hand, we make use of a recursive Nadaraya- 
Watson estimator for the estimation of the regression function. This 
kernel estimator takes into account the previous estimation of the 
shift parameter. We establish the almost sure convergence for both 
Robbins-Monro and Nadaraya- Watson estimators. The asymptotic 
normality of our estimates is also provided. Finally, we illustrate our 
semiparametric estimation procedure on simulated and real data. 



1. Introduction. A wide range of real-life phenomena occur periodically. 
One can think about meteorology with daily or annual cycles of tempera- 
ture [19], astronomy with the famous 11-year cycles of solar geomagnetic ac- 
tivity [23], medicine with human circadian rhythms [39] or EGG signals [36], 
econometry [2, 26], communication [11], etc. Statistical analysis of periodic 
data is of great interest in order to design suitable models for those cyclic 
phenomena. An important literature is available on the so-called periodic 
shape-invariant model introduced by Lawton, Sylvestre and Maggio [24]. 
Theoretical advances on shape-invariant models together with statistical ap- 
plications may be found in [17, 19-21, 38, 39]. A periodic shape-invariant 
model is a semiparametric regression model with an unknown periodic shape 
function. It is given, for all n > 0, by 
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where the inputs are known observation times, the output (Yn) are 

the observations, and are unknown random errors. The function h is 
periodic and takes the form 



where / represents the unknown characteristic shape function, m is the 
overall mean, while 9 = {6i,. . . , Op) and a = (ai, . . . , Op) are unknown shift 
and scale parameters. 

In this paper, we shall focus our attention on the particular case p = 1, 
m = and a = 1 by studying the semiparametric regression model given, for 
all n > 0, by 



where {Xn) and are two independent sequences of independent and 
identically distributed random variables. We are dealing with random obser- 
vation times in contrast with the previous literature where {Xn) are assumed 
to be known and equidistributed over a given interval. We are interested in 
the parametric estimation of the shift parameter 9 together with the non- 
parametric estimation of the shape function /. However, one has to keep 
in mind that our main interest lies in the estimation of the parameter 6. 
We are also motivated by a statistical application on the detection of atrial 
fibrillation using ECG analysis [6, 36]. 

First of all, we implement a Robbins-Monro procedure in order to esti- 
mate the unknown parameter 9 without any preliminary evaluation of the 
regression function /. Our approach is very easy to handle and it performs 
very well. Moreover, our approach is totally different from the one recently 
proposed by Dalalyan, Golubev and Tsybakov [7] in the Gaussian white- 
noise case. First, a penalized maximum likelihood estimator of 9 is proposed 
in [7] with an appropriately chosen penalty based on a Fourier series ap- 
proximation of the function /. Second, the asymptotic behavior of the mean 
squared risk of this estimator is investigated. One can observe that our 
estimator is much easier to calculate. In addition, we do not require any 
assumption on the derivatives of the function /. In the situation where the 
parameter 9 is random, Castillo and Loubes [3] propose a plug-in version of 
the Parzen-Rosenblatt [30, 33] density estimator of 0. The construction of 
this estimate also relies on the penalized maximum likelihood estimator of 9 
given in [7]. Furthermore, in the case where one observes several Gaussian 
functions differing from each other by a translation parameter, Gamboa, 
Loubes and Maza [11] propose to transform the starting model by using 
a discrete Fourier transform. Hence, from the resulting model, they estimate 
the shift parameters by minimizing a quadratic functional. This approach 



p 




k=l 



(1.2) 



Yn = f{Xn-9) + e, 
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is very interesting by the few assumptions made on the regression function. 
In a more general framework, Vimond [38] makes use of a truncated Fourier 
approximation of / in order to evaluate the profile log-likelihood score func- 
tion associated with the shift and scale parameters. This two-step strategy 
requires, as in [11], the estimation of the Fourier coefficients of /. However, 
it performs pretty well as it leads to consistent and asymptotically efficient 
estimators of the shift and scale parameters. Our alternative approach to 
estimate is associated to a stochastic recursive algorithm similar to that 
of Robbins-Monro [32, 33]. 

Assume that one can find a function (p, free of the parameter 9, such that 
0(0) = 0. Then, it is possible to estimate 9 by the Robbins-Monro algorithm 

(1-3) 9n+l = 9n + 'ynTn+l, 

where (7^) is a positive sequence of real numbers decreasing toward zero 
and (T„) is a sequence of random variables such that E[T„+i|J>i] = (p{9n) 
where J-'n stands for the cr-algebra of the events occurring up to time n. 
Under standard conditions on the function (j) and on the sequence (7n), 
it is well known [9, 22] that 0„ tends to 9 almost surely. The asymptotic 
normality of 9n together with the quadratic strong law may also be found 
in [13, 27] and [31]. A randomly truncated version of the Robbins-Monro 
algorithm is also given in [4, 25]. 

Our second goal is the estimation of the unknown regression function /. 
A wide range of literature is available on nonparametric estimation of a re- 
gression function. We refer the reader to [8, 37] for two excellent books on 
density and regression function estimation. Here, we focus our attention on 
the Nadaraya- Watson estimator of /. The almost sure convergence of the 
Nadaraya- Watson estimator [28, 40] without the shift 9 was established by 
Noda [29]; see also Hardle et al. [15, 16] for the law of iterated logarithm 
and the uniform strong law. A nice extension of the previous results may 
be found in [18]. The asymptotic normality of the Nadaraya- Watson esti- 
mator was proved by Schuster [34]. Moreover, Choi, Hall and Rousson [5] 
propose three data-sharpening versions of the Nadaraya-Watson estimator 
in order to reduce the asymptotic variance in the central limit theorem. Fur- 
thermore, in the situation where the regression function is monotone. Hall 
and Huang [14] provide a method for monotonizing the Nadaraya-Watson 
estimator. For n large enough, their alternative estimator coincides with the 
standard Nadaraya-Watson estimator on a compact interval where the re- 
gression function / is monotone. In our situation, we propose to make use 
of a recursive Nadaraya-Watson estimator [9] of / which takes into account 
the previous estimation of the shift parameter 9. It is given, for all x G M, 
by 



(1.4) fn{x) 
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with 



Wn{x) = —K{ 



where the kernel i^T is a chosen probabihty density function and the band- 
width {hn) is a sequence of positive real numbers decreasing to zero. The 
main difficulty arising here is that we have to deal with the additional 
term On inside the kernel K. Consequently, we are led to analyze a dou- 
ble stochastic algorithm with, at the samej;ime, the study of the asymptotic 
behavior ofthe Robbins-Monro estimator of 9, and the Nadaraya- Watson 
estimator /„ of /. 

The paper is organized as follows. Section 2 is devoted to the parametric 
estimation of 0. We establish the almost sure convergence of On as well as 
a law of iterated logarithm and the asymptotic normality. Section 3 deals 
with the nonparametric estimation of /. Under standard regularity assumg^- 
tions on the kernel we prove the almost sure pointwise convergence of fn 
to /. In addition, we also establish the asymptotic normality of /„. Section 4 
contains some numerical experiments on simulated and real ECG data, illus- 
trating the performances of our semiparametric estimation procedure. The 
proofs ofthe parametric results are given in Section 5, while those concerning 
the nonparametric results are postponed to Section 6. 

2. Estimation of the shift. First of all, we focus our attention on the 
estimation of the shift parameter in the semiparametric regression model 
given by (1.2). We assume that (e„) is a sequence of independent and iden- 
tically distributed random variables with zero mean and unknown positive 
variance cr^. Moreover, it is necessary to make several hypotheses similar to 
those of [7]. 

(^i) The observation times {Xn) are independent and identically dis- 
tributed with probability density function g, positive on its support 
[—1/2,1/2]. In addition, g is continuous, twice differentiable with 
bounded derivatives. 

, . The shape function / is symmetric, bounded, periodic with pe- 
^^2) riodl. 

Let X be a random variable sharing the same distribution as In all 

the sequel, the auxiliary function (j) defined, for all t G M, by 

"sin(27r(X - t)) 



(2.1) (/>(t) = E 



-f{X-0) 



9{X) 

will play a prominent role. More precisely, it follows from the periodicity 
of / that 

/•1/2 

(/>(t)= / sm{2-K{x-t))f{x-0)dx 

J -1/2 
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smi2TT {y + e-t))f{y)dy, 

-1/2 



sm{2Tr{9-t)) [ cos{2Try) f (y) dy 

7-1/2 

+ cos(27r(6'-t)) J 



1/2 

sm{2TTy)f{y)dy. 

/2 



Consequently, the symmetry of / leads to 

(2.2) </>(*) = /isin(27r(0-t)), 

where /i is the first Fourier coefficient of / 

/i = / cos{2TTx)f{x)dx. 

J -1/2 

Throughout the paper, we assume that /i ^ 0. Obviously, is a continuous 
and bounded function such that 0(0) = 0. In addition, one can easily verify 
that for alH € M such that \t — 9\ < 1/2, the product {t — 9)(j){t) has a constant 
sign. It is negative if fi > 0, while it is positive if fi < 0. Therefore, we 
are in position to implement our Robbins-Monro procedure [32, 33]. Let 
K = [—1/4,1/4] and denote by ttk the projection on the compact set K 
defined, for all x G M, by 



X, if |x| < 1/4, 

1/4, if X > 1/4, 
-1/4, ifx<-l/4. 



Let (7„) be a decreasing sequence of positive real numbers satisfying 

oo oo 

(2.3) ^7„ = +cx) and ^7^<+oo. 

n=l n=l 

For the sake of clarity, we shall make use of 7^ = 1/n. We estimate the shift 
parameter 9 via the projected Robbins-Monro algorithm 

(2.4) 9n+i = TTK{9n + sign(/i)7„+iT„+i) , 

where the initial value 9o £ K and the random variable T„+i is defined by 

.^ rj. sin(27r(X„+i -g„)) 
(2-5) T„+i = — Yn+i- 

Our first result concerns the almost sure convergence of the estimator 9n ■ 
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Theorem 2.1. Assume that (Hi) and (712) hold and that \6\ < 1/4. 
Then, On converges almost surely to 9. In addition, the number of times 
that the random variable 0„ + sign(/i)7„_|_iT„+i goes outside of K is almost 
surely finite. 

In order to establish the asymptotic normahty of On, it is necessary to 
introduce a second auxihary function 93 defined, for all t G M, by 

"sin2(27r(X-t)) 2/ 



=E 



(2.6) 



1/2 sin2(2^(x-t))^^2 
■1/2 



9{x) 



(f-{X-0)+a^) 
{f\x-9) + a'^)dx. 



As soon as 47r|/i| > 1, denote 
(2.7) e{0) 



47r|/i 



Theorem 2.2. Assume that (Hi) and (712) hold and that \0\ < 1/4. 
In addition, suppose that (e„) has a finite moment of order > 2 and that 
47r|/i| > 1. Then, we have the asymptotic normality 

(2.8) v^{dn-o)^N{{),em. 

Remark 2.1. We clearly have (f)' {t) = — 27r/i cos{2tt{0 — t)). Consequently, 
the value (l)'{0) = — 27r/i does not depend upon the unknown parameter 9. 
On the one hand, if the first Fourier coefficient fi of / is known, it is possi- 
ble to provide, via a slight modification of (2.4), an asymptotically efficient 
estimator of 0. More precisely, it is only necessary to replace 7^ = 1/ra 
in (2.4) by 7„ = 7/n where 

1 

7: 



2vr|/: 



Then, we deduce from the original work of Fabian [10] that On is an asymp- 
totically efficient estimator of with 

(2.9) v^(^„_e) Aaa(o,£^). 

On the other hand, if fi is unknown, it is also possible to provide by the 
same procedure an asymptotically efficient estimator On of 9 replacing /i by 
its natural estimate 

7 _ l>^ ncos(2^(Xfc-gfc_i)) 
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Remark 2.2. In the particular case where 47r|/i| = 1, it is also possible 
to show [9] that 



log(n) 



Asymptotic results are also available when < 47r|/i| < 1. However, we have 
chosen to focus our attention on the more attractive case 47r|/i| > 1. 

Theorem 2.3. Assume that (T-Li) and ('H2) hold and that \6\ < 1/4. 
In addition, suppose that (e„) has a finite moment of order > 2 and that 
47r|/i| > 1. Then, we have the law of iterated logarithm 

f n ^ f n ^ 

hmsup -— [On - 9) = -hminf -— - 6) 

n^oo V 2 log log n/ n-!>oo \21oglogny 

(2.10) 

= C{9) a.s. 

In particular, 

(2.11) limsupf— )(en-ef = e{0) a.s. 

V 2 log log ny 

In addition, we also have the quadratic strong law 

1 " ^ 

(2.12) hm V(0fc - Of = eiO) a.s. 

n-s>oo logn ^-^ 
k=l 

Proof. The proofs are given in Section 5. □ 

Remark 2.3. It is also possible to get rid of the symmetry assumption 
on /. However, it requires the knowledge of the first Fourier coefficients of /: 

/■I/2 rl/2 
fi= cos{2'Kx)f{x)dx and gi = sm{2irx)f{x)dx. 

J-1/2 

On the one hand, it is necessary to assume that /i 7^ or gi ^ 0, and to 
replace the first auxiliary function (p defined in (2.1) by 



m = /lE 



M2niX-t))_^^^_^^ 



cos(27r(X-t)) 



9{X) 

= (/2+g2)sin(2vr(0-t)). 
Then, Theorem 2.1 is true for the projected Robbins-Monro algorithm 

9n+l = T^IiiOn + Jn+lTn+l)-, 
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where the initial value £ K and the random variable T^+i is defined by 
rj, _ /isin(27r(X„+i - On)) ^ _ Qi cos(27r(Xn+i - 9n)) ^ 

g{Xn+l) 9[Xn+l) 

On the other hand, we also have to replace the second function ip defined 
in (2.6) by 

" if I sin(27r(X -t))-gi cos(27r(X -t))f 



.{f\X-e) + a') 



1/2 5(2;) 

Then, as soon as 4vr(/i + g\) > 1, Theorems 2.2 and 2.3 hold with 



In the rest of the paper, we shall not go in that direction as our strategy is 
to make very few assumptions on the Fourier coefficients of /. 

3. Estimation of the regression function. This section is devoted to the 
nonparametric estimation of the regression function / via a recursive Nada- 
raya-Watson estimator. On the one hand, we add the standard hypothesis: 

(7^3) The regression function / is Lipschitz. 

On the other hand, we recall that under (^2), the function / is assumed to be 
symmetric. Consequently, we follow the same approach as the one developed 
by Stone [35] for the estimation of a symmetric probability density function 
replacing the estimator (1.4) by its symmetrized version 

where 

Wn{x) = —K\ 



The bandwidth (/i„) is a sequence of positive real numbers, decreasing to 
zero, such that nhn tends to infinity. For the sake of simplicity, we propose 
to make use of = 1/n" with a G ]0, 1[. Moreover, we shall assume in all 
the sequel that the kernel i^T is a positive symmetric function, bounded with 
compact support, twice differentiable with bounded derivatives, satisfying 

/ K{x)dx = l and / (x) dx = u"^ . 
Jr Jr 

Our next result deals with the almost sure convergence of the estimator /„. 
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Theorem 3.1. Assume that (Hi), (712) and (Hs) hold and that \9\ < 
1/4 and the sequence (e„) has a finite moment of order > 2. Then, for any 
X G M such that \x\ < 1/2, 

(3.2) lim fn{x) = f{x) a.s. 



The asymptotic normality of the estimator /„ is as fohows. 

Theorem 3.2. Assume that (T-Li), ('H2) and (H-s) hold and that \9\ < 
1/4 and the sequence (e^) has a finite moment of order > 2. Then, as soon 
as the bandwidth (hn) satisfies hn = l/n" with a > 1/3, we have for any 
X G M such that \x\ < 1/2 with x / 0, the pointwise asymptotic normality 

/ 22 



(3.3) y^ifnix)- fix))^M(o, 



In addition, for x = 0, 



il + a){g{9 + x) + g{9-x))J- 

(3.4) y;^(/„(o)-/(o)) Aaa(^o 



{l + a)g{9) 

Proof. The proofs are given in Section 6. □ 

4. Simulations. The goal of this section is to illustrate via some numeri- 
cal experiments the good performances of our estimation strategy. The first 
subsection is devoted to simulated data created according to the model (1.2) 
while the second one deals with real ECG data taken from the MIT-BIH 
database. Our aim is to propose an efficient and easy to handle procedure 
in order to detect atrial fibrillation using ECG records. An interesting study 
on ECG analysis in order to detect cardiac arrhythmia may also be found 
in [36]. 

4.1. Simulated data. Consider the semiparametric regression model 

Yn = f{Xn-9) + en, 

where ^ = 1/10 and the periodic shape function / is given, for p>l and for 
all X G M, by 

p 

/(x) = ^2 cos(2/c7rx) 
fc=i 

with p = 8. We have chosen (X„) and (e^) as two independent sequences of 
independent random variables with ZY[— 1/2, 1/2] and M{0, 1) distributions, 
respectively. The simulated data are given in the left-hand side of Figure 1 . 
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For the estimation of the shift parameter 6, we implement our Robbins- 
Monro procedure with n = 1000 iterations. We obtain the estimate 9n = 
0.1014 which shows the good asymptotic behavior of the estimator On com- 
paring to the true value 0= 1/10. Moreover, using convergence (2.8), one 
can obtain confidence intervals for the shift parameter. More precisely, they 
are given, for all n > 1, by 



Ini9) 



n 



n 



where qp stands for the quantile of order < /3 < 1 of the A/'(0, 1) distribution 
and £,n{d) is a consistent estimator of ^{6) given by (2.7). In our particular 
case, it is not necessary to estimate i'^{9) since via straightforward calcula- 
tions, /i = 1/2 and 



e{e) 



8(27r- 1) 



Moreover, for n = 1000 and for a risk /3 = 5%, the confidence interval is 
precisely ln{0) = [0.0762; 0.1266]. The length of ln{0) is 0.0504, which is 
rather small, so our Robbins-Monro procedure performs pretty well. All 
confidence intervals In{9), for n = 1, . . . , 1000, are drawn in red in the left- 
hand side of Figure 2. 

For the estimation of the regression function /, we make use of the uniform 
kernel K on the interval [—1,1], and the bandwidth hn = 1/n" with a = 
9/10. In addition, it follows from convergences (3.3) and (3.4) that for n = 
1000 and for all x £ [—1/2, 1/2], a confidence interval for f{x) is given by 



Jnix) 



fn{x) - qp 



y/nhr, 
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where stands for the quantile of order < /? < 1 of the A/'(0, 1) distribution 

and v'^{x,9n) is a consistent estimator of the asymptotic variance v^{x,6) in 
Theorem 3.2. In our particular case, i/^ = 1/2 and 

'5/19, if -1/2 < x < -2/ or 2/5 < a; < 1/2, 
)=J5/38, if-2/5<x<2/5 andx/0, 
^5/19, if3; = 0. 

All confidence intervals Jnix), for all x G [—1/2,1/2], are drawn in red 
in the right-hand side of Figure 2. On the one hand, the simulations show 
that the largest length of the confidence intervals Jn{x) is for x = —0.47 
and X = 0.47 and the length is precisely equal to 1.0066. On the other hand, 
the smallest length of the confidence intervals Jn{x) is for x = —0.04 and 
X = 0.04 and is equal to 0.7118. The fact that there are two values of x 
for the largest and the smallest length of confidence intervals is due to the 
symmetry of the estimator /„. Then, one can observe on this first set of 
simulated data that the Robbins-Monro estimator 9n of 9 as well as the 
Nadaraya- Watson estimator /„ of / perform pretty well. 

Our second experiment deals with 30 curves according to the model 

Yn = f{Xn-9) + en, 

where 9 = —1/5 for the first 10 curves and 9' = 1/10 for the last 20 curves. 
The periodic shape function / is given, for all x £ [—1/2, 1/2], by 

/(x) = cos(27rx) + sin(27rx) + cos(27r2;) sin(27r2;). 

Our goal is to propose a statistical procedure in order to detect a lag be- 
tween the first 10 curves with 9 = —1/5 and the last 20 curves with 9' = 1/10. 
In other words, we want to observe whether or not the value A = 9' — 9 is 
far away from zero. We have chosen (Xn) and (e„) as two independent 
sequences of independent and Gaussian random variables with uniform dis- 
tribution on [—1/2, 1/2] and JV{0, 1/5) distribution, respectively. Each curve 
is drawn with n = 200 points. The different curves are given in Figure 3. 
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2.5^ 

2.0 

1.5 

1.0 

0.5 

0.0 
-0.5 
-1.0 
-1.5 

-2.0H . 1 . 1 ^ \ ^ \ ^ \ . 1 . 1 . 1 . 1 . 1 

-0.5 -0.4 -0.3 -0.2 -0.1 0.0 0.1 0.2 0.3 0.4 0.5 

Fig. 3. Simulated data with two different values 6 and 9' . 

On the one hand, we estimate the first value 9 = —1/5 from the first 10 
curves. We implement our Robbins-Monro procedure with n = 200 iterations 
for the first estimate On of 9 evaluated on the first curve, then with n = 
400 iterations for the second estimate 9^ of 9 evaluated on the two first 
curves, and so on, until the calculation of the last estimate On of 9 with 
n = 2000. Therefore, we obtain —0.1950 for the arithmetic mean of the first 
10 estimates On of 0. We continue with the same procedure on all the set 
of curves. The value of the eleven estimates with n = 2200 is 0.0986. This 
value is significantly different from the first 10 estimates. It corresponds to 
the first curve simulated with 0' = 1/10. Furthermore, we obtain 0.0998 for 
the arithmetic mean of the last 20 estimates On of 0' . Finally, our statistical 
procedure allows us to detect a change of parameterization from the value 
61 = -1/5 to the value 0' = 1/10 as A„ = 0.0998 + 0.1950 = 0.2948. In order 
to compute more accurate values of On-, one can replace 7„ = 1/n in (2.4) by 
7„ = l/n"" where 1/2 < a < 1. This will be done for the implementation of 
our Robbins-Monro procedure on real ECG data. 

4.2. Real ECG data. We shall now focus our attention on real ECG data. 
We have chosen the record 04015 in the Atrial Fibrillation (AF) database 
provided by MIT-BIH database. Each recording consists in a continuous 
digitized ECG signal measured over 1 hour in order to detect AF which is the 
most common cardiac arrythmia. A stronger indicator of AF is the absence 
of P waves or the irregularities of RR interval on an electrocardiogram. We 
refer the reader to [6] for an interesting book on statistical methods and 
tools for ECG data analysis. Our aim is to propose a statistical procedure 
in order to detect irregularities of RR interval on the ECG record 04015. The 
record and its projection on the interval [—1/2,1/2] are given in Figure 4. 
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2.0- 




Fig. 4. Original data. 



The size of the data set is 2038. We assume that the model 

Yn = f{Xn-9) + en 

fits the data, where the sequence (Xn) is uniformly distributed over the 
interval [—1/2, 1/2]. The periodic shape function / is clearly not symmetric. 
However, we already saw in Remark 2.3 that our Robbins-Monro procedure 
still holds for nonsymmetric regression function. 

As for simulated data, in view of the signal, we would find two different 
values 6 and 6' . The first value 9 is associated with the first part of the signal, 
while the second value 6' corresponds to the second part. The difference 
A = 6' — 6 between the two parameters would explain the lag between the 
two parts of the signal. A value of A far away from zero could be interpreted 
as the detection of irregularities of RR interval which confirms the diagnostic 
of atrial fibrillation. On this record, our Robbins-Monro procedure with 
n = 800 iterations leads to the first estimate On = 0.1734 for 6 and the last 
estimate 9n = -0.0092 for 9' with n = 1238. The value A„ = -0.0092 - 
0.1734 = —0.1826 explains the lag in Figure 4. Figure 5 shows that our 



1.5-| ; ; ; ; ; ; ; ; ; , 1.5 




-1.5-1 : 1 : 1 : 1 : 1 : 1 : 1 : 1 : 1 : 1 : 1 -1.5^ . \ ■ \ . 1 . 1 . 1 . 1 . 1 . 1 . 1 . 

-0.5 -0.4 -0.3 -0.2 -0.1 0.0 0.1 0.2 0.3 0.4 0.5 -0.5 -0.4 -0.3 -0.2 -0.1 0.0 0.1 0.2 0.3 0.4 0.5 



Fig. 5. Reconstruction of the EGG. 



14 



B. BERCU AND P. FRAYSSE 



Nadaraya-Watson procedure for the reconstruction of ECG signals works 
pretty well. 

5. Proofs of the parametric results. 

5.1. Proof of Theorem 2.1. We can assume without loss of generality 
that /i > inasmuch as the proof for /i < follows exactly the same lines. 
Denote by Fn the (7-algebra of the events occurring up to time n, Tn = 
(7(Xo,eo, . . . First of all, we shall calculate the two first conditional 

moments of the random variable r„ given by (2.5). It follows from (1.2) that 



E[r„+i|j-j=E 



sin(27r(X„+i - 6',,))y„+i 



a{Xn+i) 

sin(27r(X„+i - 0„))(/(X„+i -9) + 



g{Xn+i) 



F n 



On the one hand, as (X„) is a sequence of independent random variables 
sharing the same distribution as a random variable X, we have 



(5.1) 



E 



sin(27r(X„+i - en))f{Xn+i 



g{Xn 



+1; 







a.s. , 



where (f) is the function given by (2.1). On the other hand, as (X„,) and (e^) 
are two independent sequences and (e^) is a sequence of independent and 
square integrable random variables with zero mean, we also have 



E 



sin(27r(X„+i - 6'n))en+i 



■J n 



Hence, (5.1) leads to 

(5.2) Wn+l\J'n 

On the other hand, 

„ _sin2(27r(X„+i-^„))y„% 



:E 



sin(27r(X - 6n)) 



E[e„ 



0. 



a.s. 



sin2(27r(X„+i - ^„))(/2(X„+i -9) + 2e„H_i/(X„+i - 9) + el^,) 



9HX 



n+l) 



Consequently, as the function / is bounded, the density g is positive on 
[-1/2,1/2], and E[e^_^J = £[4^^] = cr^, we obtain that 



(5.3) E[r2 |J-„]=E 



sin2(27r(X-e„)) ,^2 



9HX) 



{f\X-9) + a') 
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where (p is given by (2.6). Therefore, as / is bounded and g does not vanish 
on its support [—1/2,1/2], we deduce from (5.3) that for some constant 
M>0 

(5.4) supE[r2_^i|J"„] <M a.s. 

n>0 

Furthermore, for aU n > 0, let = {9^ — 9)'^ . We clearly have 
Vn+i = {9n+i — ^)^ 

= (vrx(^n + 7n+l^n+l) " 

= (vrx(^n + 7n+l^n+l) " T^K{9)f 

as we have assumed that 9 belongs to K. Since ttk is a Lipschitz function 
with Lipschitz constant 1, we obtain that 

Vn+l < {9n + ^n+lTfi+l — 9)"^ 

<Vn+ ll+X+i + 2^n+lTn+l(9n - 9). 

Hence, it follows from (5.2) and (5.4) that 

E[K+l|-^n] <Vn + 7n+lIE[7;\i| + 27„+i(^„ - 9)¥.[Tn+l\Fn\ 

(5-5) 

<K + 7^+iM + 27„+i(e„-e)0(^„) a.s. 

In addition, as 9^ G \9n\ < 1/4, \9n — 9\ < 1/2 which implies that (0„ — 
9)(f)[9n) < 0. Then, we deduce from (5.5) together with the Robbins-Siegmund 
theorem (see Duflo [9], page 18) that the sequence (Vn) converges a.s. to a fi- 
nite random variable V and 

oo 

(5.6) ^7„+i(^ - 9n)H^n) < +00 a.s. 

n=l 

Assume by contradiction that V ^0 a.s. Then, one can find 0<a<6< 1/2 
such that, for n large enough, the event {a < \9n — 9\ < b} is not negligible. 
However, on this annulus, one can also find some constant c > such that 
{9 — 9n)(t>{9n) > c which, by (5.6), implies that 

oo 

^7n < +00. 
n=l 

This is of course in contradiction with assumption (2.3). Consequently, it 
fohows that V = a.s. leading to the almost sure convergence of 9n to 9. 
It remains to show that 9n + jn+iTn+i goes almost surely outside of K 
a finite number of times. For all n > 1, denote 

n-l 

Nn = X]^{|0fe+7fe+l^fc+l|>l/4}■ 
fc=O 
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The random sequence (Nn) is nondecreasing. Assume by contradiction 
that Nn goes to infinity a.s. Then, one can find a subsequence (n^) such 
that (Nnf,) is increasing. Consequently, for ah n^, > 0, 

l^rife + 7nfc+l7nj.+i| > I a.S., 

which imphes that = 1/4 a.s. Hence, 

lim \6n, I = 1^1 = T a-s. 

rifc— 5>oo 4 

leading to a contradiction as \6\ < 1/4. Finally, {Nn) converges to a finite 
limiting value a.s. which completes the proof of Theorem 2.1. 

5.2. Proof of Theorem 2.2. We assume without loss of generality that 
/i > 0. Our goal is to apply Theorem 2.1 of Kushner and Yin ([22], page 330). 
First of all, as 7„ = 1/n, the condition on the decreasing step is satisfied. 
Moreover, we already saw that On converges almost surely to 9. Conse- 
quently, all the local assumptions of Theorem 2.1 of [22] are satisfied. In ad- 
dition, it follows from (5.2) that E[T„+i]J>i] = 4>{6n) a.s. and the function (j) 
is continuously differentiable since (t){t) = fi sin(27r(0 — t)). Hence, (j){6) = 
and (j)' {9) = — 27r/i and 47r/i > 1. Furthermore, we deduce from (5.3) that 

E[r^_^il j;j = 'f{9n) a.s., 

which leads to 

Yiui¥.[Tl^^\Fn]=^{9) a.s. 

n— >oo 

Consequently, if we are able to prove that the sequence iWn) given by 

In 

is tight, then we shall deduce from Theorem 2.1 of [22] that 

^[9n-9)^N{^,e{e)), 

where 

m 



i\0) = ^{9) exp((l-47r/i)t)dt: 



4^/i - 1 

Therefore, it remains to prove the tightness of the sequence {Wn). It follows 
from (5.5) that for some constant M > and for all n > 1, 

(5.7) E[I^„+il j;] < (1 + ln)Wn + In+lM + 2{9n " ^)</'(^n). 

Moreover, we have for all x G M, (l){x) = 2TTfi{9 — x) -\- fi{9 — x)v{x) where 

, , sm(27T(9-x))-2TT(9-x) 
'"{^> = 77, ^ • 
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By the continuity of the function v, one can find < e < 1/2 such that, if 

\x — 9\ < e, 

(5.8) ^<^(x)<o. 
We also deduce from (5.7) that for all n>l, 

(5.9) E[VF„+i| <Wn + 2^rrWn{q " /l^'(^n)) + 7nM 

with 2q = l — 47r/i which means that q <0. Moreover, let An and Bn be the 
sets An = {\6n — G\ < e} and 



k=m 

with 1 <ni<n. Then, it follows from (5.8) that 



(5.10) 0<-hv{9n)lB„<-{l]lB^. 



E[Wn+llB„ \J^n] < Wnls^ + 27„VF„Ib„ ( <? " | ) + 7nM 



Hence, we deduce from the conjunction of (5.9) and (5.10) that for all n>m, 

(f 
2 

(5.11) 

<WnlBM + (lln)+7nM. 

Since Bn+i = BnCi An+i, Bn+i C Bn, and we obtain by taking the expecta- 
tion on both sides of (5.11) that for all n > m, 

(5.12) E[Wn+llB„+,] < (1 + q^nMWnlBj + 7nM. 

From now on, denote a„ = E[W„Ib^]. We infer from (5.12) that for all n>m, 

n n 

(5.13) a„+i < (3nam + M/3„ ^ ^ where /3„ = J] (1 + qj^)- 

k=m k=m 

As 7„ = 1/n, it follows from straightforward calculations that Pn = 0{n'^) 
and 

n 

fe=i 

Consequently, (5.13) immediately leads to 

(5.14) sup a,i < +00. 

We are now in position to prove the tightness of the sequence iWn)- Indeed, it 
was already proved in Theorem 2.1 that On converges to a.s. Consequently, 
if 



k>n 
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then P(C„) converges to zero as n tends to infinity. Moreover, for n>m, 
Bn C Cm wliich implies that as m,n tend to infinity, ¥{Bn) goes to zero. 
For all ^, i^' > and for all n > m with m large enough, 

>K)< nWnlB^ > K/2) + nWnl-B > K/2) 

(5.15) 

<-|E[H^jBj+P(^n). 

We deduce from (5.14) that one can find K depending on ^ such that the 
first term on the right-hand side of (5.15) is smaller than ^/2. It is also the 
case for the second term as ¥{Bn) goes to zero. Finally, for all ^ > 0, it exists 
K >Q such that for m large enough, 

sup >K)<C, 
n>m 

which implies the tightness of iyVn) and completes the proof of Theorem 2.2. 

5.3. Proof of Theorem 2.3. As the number of times that the random 
variable On + ^n+iTn+i goes outside of K is almost surely finite, the se- 
quence {On) shares the same almost sure asymptotic properties as the classi- 
cal Robbins-Monro algorithm. Consequently, we deduce the law of iterated 
logarithm given by (2.10) from Theorem 1 of [12]; see also Hall and Heyde 
([13], page 240), and the quadratic strong law given by (2.12) from Theo- 
rem 3 of [31]. 

6. Proofs of the nonparametric results. 

6.1. Proof of Theorem 3.1. In order to prove the almost sure pointwise 
convergence of Theorem 3.1, we shall denote for all rr E R 

^ n 1 " 

hn{x) = -y^Wk{x)Yk and ff„(x) = - V Wfc(x). 

k=l k=l 

As in [1], we obtain from (1.2) the decomposition 

(6.1) nhn{x) = Mn{x) + Pn{x) + Qn{x) + ngn{x)f{x), 

(6.2) ngn{x) = Nn{x) + Rn{x) + ng{0 + x), 
where 

n 

(6.3) Mn{x)=Y,Wk{x)ek, 

k=l 

n 

(6.4) 7V„(x) = ^VFfc(x)-E[VFfc(x)|J-fc_i] 

k=\ 
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and 

n 

(6.5) Pn{x) = Y,Wk{x){f{Xk - Ok-i) - fix)), 



k=l 

n 



(6.6) Qn{x) = Y,Wk{x){f{Xk -9)- f{Xk - 9k-i)), 



k=l 
n 



(6.7) Rn{x) = J2inWk{x)\Tk~i] - 9{0 + x)). 

k=l 

On the one hand, 

nWnix)\J^n-l]= [ ^K(^^^^^^^^)g{Xn)dXr,. 

After the change of variables z = h~^{xn — dn-i — x), as the density func- 
tion g is continuous, twice differentiable with bounded derivatives, we infer 
from the Taylor formula that 

E[Wn{x)\Tn~l] 



K{z)g{9n~i +X + hnz) dz 

(6.8) = / K{z){g{en^i+x) + Kzg'{en-i + x) 

■JR V 



h?' ^ 

+ -^g'i^n-l +X + hnZi) ] dz 
hi 



= g{en-i+x) + ^ / z'^K{z)g"{en^i + x + Kzi)dz, 

^ JR 

where < ^ < 1. Consequently, for all n > 1, 

(6.9) \E[Wnix)\J^n-i] - giOn-1 + x)\ < MgT^hl a.s., 

where Mg = sup^^^\g" {x)\ and 



T^ = l [ x^K{x)dx. 
2 Jm. 



The continuity of g together with the fact that 0„ converges to 9 a.s. leads 
to 

1 " 

(6.10) \im -y^E\Wk{x)\Tt^i] = g{9 + x) a.s., 

k=l 

which immediately implies that for all x G M 

(6.11) Rn{x) = o{n) a.s. 
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On the other hand, (A^„,(x)) is a square integrable martingale difference 
sequence with predictable quadratic variation given by 

n 

{N{x))n = Y,n{Nk{x) - Nk-l{x)f\Fk-l\ 
k=l 

n 

= J2nwi{x)\Tk-i]-^^[Wk{x)\Tk-i]. 

k=l 

It follows from the same calculation as in (6.8) that 
E[W^{x)\Tn.i] = / K^{z)g{en-i +X + hnz) dz 

= -^ff(^„_i + x) + ^ / z'K\z)g"{en-i+x + hnzOdz, 
where < < 1, which leads to 



(6.12) 
with 

Hence, since 



E[W^{x)\Tn^i]-—g{en^,+x' - 



< Mg/i hn a.s. 
1/2= /" K'^(x)dx and fJ'^ = - [ x^K^{x)dx. 

1 " 1 
lim —T: — >^ h7^ = 

k=l 



we deduce from (6.9) and (6.12) together with the Toeplitz lemma and the 
almost sure convergence of g{6n + x) to g{6 + x) that 

(6.13) hm = a.s. 

Consequently, we obtain from the strong law of large numbers for mar- 
tingales given, for example, by Theorem 1.3.15 of [9] that for any 7 > 0, 
{Nn{x))'^ = o(ni+"(logn)i+''') a.s. which ensures that, for all x G M 

(6.14) Nn{x) = o{n) a.s. 

Therefore, it follows from (6.2), (6.11) and (6.14) that for all x G M 

(6.15) lim. ^n{x) = g{9 + x) a.s. 

n— >oo 

Moreover, the kernel K is compactly supported which means that one can 
find a positive constant A such that K vanishes outside the interval [— j4, A]. 
Thus, for all n > 1 and all x G M, 

we — ^n-On-i -x \ 
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In addition, the function / is Lipschitz, so there exists a positive constant Cf 
such that for ah n > 1 

- On-l) - f{x)\ < Cf\Xn - 9n-l " x\. 

Consequently, we obtain from (6.5) that for all x € M 



\Pnix)\<Cf^Wk{x)\Xk-ek-l-x\ 



k=l 

(6.16) 

n 

<ACfY,f^kWk{x). 

k=l 

Hence, it follows from convergence (6.10) together with (6.14) and (6.16) 
that for all X E M 

(6.17) Pnix) = o{n) a.s. 
Furthermore, we obtain from (6.6) that for all x G M 

n 

(6.18) \Qn{x)\<CfJ2Wk{x)\9k-i-0\. 

k=l 

Then, it follows from the Cauchy-Schwarz inequality that 

n n 

(6.19) Qlix) < cj J2 wiix) J2 - e\^. 

k=l k=l 

We can split the first sum at the right-hand side of (6.19) into two terms. 



^Wi{x) = In{x) + Jn{x), 



k=l 



where 



Inix)=Y,Wi{x) - E[Wiix)\Tk-i] 



k=l 
n 

Ux)=Y,nwi{x)\Tk^i]. 

k=l 

Following the same lines as in the proof of (6.14), it is not hard to see that 

/„(x) = o(ni+") a.s. 
We also deduce from convergence (6.13) that 

J„(x) = 0(n^+") a.s. 
Consequently, we obtain that for all x G M 



.20) ^W|(x) = 0(ni+") a.s. 



k=i 
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Therefore, we infer from the quadratic strong law given by (2.12) together 
with (6.19) and (6.20) that Qn{x) = 0(n^+" logn) a.s. which imphes that 
for ah X e M 

(6.21) Qn{x) = o{n) a.s. 

It now remains to study the asymptotic behavior of Mn{x) given by (6.3). 
As (Xn) and ( £n) are two independent sequences of independent and identi- 
cally distributed random variables, {Mn{x)) is a square integrable martingale 
difference sequence with predictable quadratic variation given by 

n 

{M{x))n = J^E[(A/4(x) - Mfc_i(x)) Vfc-i] 

k=l 

n 
k=l 

Then, it follows from convergence (6.13) that 

(0,22) ^^m^^.V9{f>^^) _ 

n->oo 1 + a 

Consequently, we obtain from the strong law of large numbers for martin- 
gales that for any 7 > 0, (M„(a;))^ = o(n"'^^"(logn)^"'"''') a.s. which leads to 

(6.23) Mn{x) = o{n) a.s. 

Therefore, we deduce from (6.1) and (6.15) together with the conjunction 
of (6.17), (6.21) and (6.23) that for ah x € M 

(6.24) Y\mhn{x) = f{x)g{e + x) a.s. 

n— >oo 

Finally, we can conclude from the identity 

7( \ ^n(a;) + hn{-x) 

(6-25) fn{x) = ^ ^ 

gn{x) + gn{-x) 

and the parity of the function / that, for all a; G R such that < 1/2, 

(6.26) lim fn{x) = f{x) a.s. 

n— >oo 

6.2. Proof of Theorem 3.2. We shall now proceed to the proof of the 
asymptotic normality of /„. It follows from (6.1), (6.2) and (6.25) that for 
all X G M 

(6.27) 7„(x)-/(x) = :^(^) + ^"(^) + 2"(^) 



nQn{x) 
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where Qnix) =gn{x) +gn{-x) and 

Mn{x) = Mn{x) + Mn{-X), 
Vn{x)=Pn{x)+Pn{-x), 
Qn{x) = Qn{x) + Qn{-x) 

with Mn{x), Pn{x) and Qn{x) given by (6.3), (6.5) and (6.6), respectively. 
We already saw from (6.15) that for all x G M 

(6.28) Wm. Gnix) = g{e + x) + g{e - x) a.s. 

n— >oo 

In order to establish the asymptotic normality, it is now necessary to be more 
precise in the almost sure rates of convergence given in (6.17) and (6.21). It 
follows from (6.16) that for all x G M 

(6.29) |P„,(x)| < ACf{Ln{x) + K{x)), 
where 

n 

Ln{x) = Y,hk{Wk{x) - nWk{x)\Fk-i]), 

k=l 



K{x) =Y,hknwk{x)\Fk-i]. 

k=l 

On the one hand, we infer from (6.9) that 

(6.30) K{x) = o(^h^=0{n^-'') a.s. 

On the other hand, {Ln{x)) is a square integrable martingale difference 
sequence with predictable quadratic variation given by 

{L{x))n = Y.hl{nwl{x)\Fk^^]-¥?[Wu{x)\Fk-i]). 

k=l 

We deduce from (6.9) and (6.12) together with the Toeplitz lemma that 

(6.31) hm = '-^M^^ a.s. 

Consequently, we obtain from the strong law of large numbers for martin- 
gales that for any 7 > 0, (-L„(x))^ = o(n-'^~" (log n)^"'"''') a.s. which clearly im- 
plies that (L„(x))^ = o{n^~^'^) a.s. Therefore, we find from (6.29) and (6.30) 
that, as soon as a > 1/3, 

(P„(x))2 = 0(n2-2") + o(7ii+") = o(n^+") a.s., 

which immediately leads to 

(6.32) (P„(x))2 = o(ni+") a.s. 
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Proceeding as in the proof of (6.32), we obtain from (6.18) that for ah x G M 

(6.33) \Qn{x)\<Cf{Snix) + ^n{x)), 

where 

n 

Sn{x) = ^ek{Wk{x) -E[Wk{x)\J^k-l]), 
k=l 

n 

E„(x)= J^4IE[W^fc(x)|-Ffc„i] 

k=l 

with in = \6n-i — 0\. We deduce from (6.9) together with the Cauchy- 
Schwarz inequahty and the quadratic strong law given by (2.12) that 

(6.34) S„(rE) = 0^f^4^ =0(Vnlogn) a.s. 

In addition, it follows from (6.12) that {Sn{x)) is a square integrable mar- 
tingale difference sequence with predictable quadratic variation satisfying 

(5(x))„ = 0(n"logn) a.s. 

Consequently, we obtain from the strong law of large numbers for mar- 
tingales that for any 7 > 0, {Sn{x))'^ = o(n"(logn)^+''') a.s. so (5„(x))^ = 
0(71^'^°') a.s. Hence, we find from (6.33) and (6.34) that 

{Qn{x))'^ = O(nlogn) + o(ni+") = o(n^+") a.s., 

which obviously implies 

(6.35) (Q„(x))2 = o(ni+") a.s. 

It remains to establish the asymptotic behavior of the dominating term 7W„(a;). 
We already saw that {Mn{x)) is a square integrable martingale difference 
sequence. Consequently, {A4n{x)) is also a square integrable martingale dif- 
ference sequence with predictable quadratic variation given by 

n 

{Mix))n = a^^E[{Wk{x) + Wk{-x)f\J^k-i]. 

k=l 

Hence, it is necessary to evaluate the cross-term K[Wn{x)Wn{—x)\Tn~i]- It 
follows from the same calculation as in (6.8) that 

E[Wn{x)Wn{-x)\Tn^l] 



n~l + X + hnZ) dz 
g{9n-l + x)In{x) + g'0n-l + x)Jn{x) 

+ ^ / z^K{z)K{z + 2h-^x)g" {en-i + X + KzOdz 
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with < 1^ < 1. Consequently, we obtain that 

^[Wn{x)Wn{-x)\Fn^l] - -^<7(^n-l + x)In{x) - g' {On^l + x)Jn{x] 

<MgHn{x)hn a.s., 

where 



In{x) 



Jn{x) 



/ K{z)K{z + 2h-^x)dz, 
Jr 

/ zK{z)K{z + 2h:^^x)dz, 
Jr 

Hn{x)= [ z^K{z)K{z + 2h^^x)dz. 
Jr 

However, as the kernel K is compactly supported, we have for all x G M with 

lim K{z + 2h-^x)=0. 

n— >oo 

Then, we deduce from the Lebesgue dominated convergence theorem that 
all the three integrals In{x), Jn{x) and Hn{x) tend to zero as n goes to 
infinity, which implies that for all x G M with x 7^ 0, 

(6.36) ^E[H^fc(x)Vrfc(-x)|J-fc_i] = oK^/i^M =o(n^+") a.s. 
fc=i \fc=i / 

Therefore, we find from (6.22) together with (6.36) that for all x G M with 
x/0, 

(6.37) lim = f^(5(e + x) + g{e - x)) a.s. 
If X = 0, it immediately follows from (6.22) 

(0,38) ^^(Mm^^4.vm 

Furthermore, it is not hard to see that the Lindeberg condition is satisfied. 
As a matter of fact, we have assumed that the sequence (e„) has a finite 
moment of order a > 2. If we denote AA^„(x) = Ainix) — Ain-iix), we have 

E[|A7W„(x)nj-„_i] =E[|e„r]E[|I^„(x) - iy„(-x)n 

which implies that 

E[|AA^„(x)nJ-„_i] < 2'^-iE[|e„r]E[W^,"(x) + I^„"(-x)|J-„_i]. 

However, it follows from the same calculation as in (6.8) that 

(6.39) 5]E[I^,"(x)|J-fc_i]=0^/.irM =0(ni+"('^"i)) a.s. 

fc=l \k=l / 
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In addition, for all e > 0, 
1 " 

k=l 



1 " 

k=l 

where b = a(l + a)/2. Consequently, it follows from (6.39) that for all e > 0, 
1 " 

k=l 

where c = (2 — a)(l — a)/2. As c < 0, the Lindeberg condition is clearly 
satisfied. We can conclude from the central limit theorem for martingales 
given, for example, by Corollary 2.1.10 of [9] that for all x G M with x ^0, 

(6.40) -^Af(o, ^{g{9 + x)+ g{d - x)) 



^/n^ \ ' 1 + a 

while, for x = 0, 

(0.41) ^^uUf^m 

Finally, it follows from (6.27) and (6.28) together with (6.32), (6.35), (6.40), 
(6.41) and the Slutsky lemma that, for all x E M such that |x| < 1/2 with 
x/0, 



V^ifnix) - fix)) A AA(^0, - 



while, for x = 0, 



+ a){g{e + x) + g{e-x))J' 



V^(/.(0)-/(0))^AA^0,^^^^^^^^^ 

which completes the proof of Theorem 3.2. 
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